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(57) Abstract 

A system for integrating electronic mail, voice mail and fax mail in a universal mailbox. Message receivers (36) may access their 
messages (12) with a telephone (24) or a computer (20) regardless of the communication medium used by the message sender (34). Using a 
telephone (24), message receivers (36) may playback voice mail, redirect fax mail, and •listen" to e-mail through a text-to-speech conversion 
process. Using a computer and modem (20), message receivers (36) may playback voice mail, view fax mail, and read e-mail by accessing 
the universal mailbox via connection software. Message senders (34) and receivers (36) may choose from a variety of filter and forward 
options that allow them to manage their communications via the universal mailbox. Forwarding and conversion of messages is performed 
automatically. The options define a set of rules to be applied to inbound and outbound messages so that messages are sent and received in 
accordance with the preferences of the senders (34) and receivers (36). 
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WO 97/49251 PCI7US97/10441 
INTEGRATED VOICE, FACSIMILE AND ELECTRONIC MAIL MESSAGING SYSTEM 



BACKGROUND OF THK INVENTION 

Field of the Invention 

The present invention relates generally to communication technologies such as 
electronic mail (e-mail), voice mail, and facsimile (fax) mail messaging. Particularly, the 
present invention relates to systems for seamlessly integrating communications to facilitate 
access to electronic mail, voice mail, and fax mail messages via multiple single access points. 
Description of the Related An 

Communications technology today allows individuals to send messages to one 
another from virtually any location in the world at virtually any time of day. The variety of 
communication modes (e.g., telephone, computer) and communication media (e.g., e-mail, 
voice mail, fax mail) available today allows individuals to choose one appropriate for the 
circumstances. For example, a sales representative in London who needs to contact a home 
office in Boston may choose to call the home office at 8:00 AM local time knowing that no 
one will be in the office to answer the call, but that voice mail is available so a message may 
be left for the appropriate party. Alternatively, the sales representative may choose to send e- 
mail to the appropriate party. 

In general, message senders today may select from a variety of communication media 
while message receivers are limited to the option selected by the message sender. If the 
sender uses the telephone to leave a voice mail message, the message receiver is required use 
a telephone to retrieve the voice mail message. If the sender uses a computer to send an e- 
mail message, the message receiver is required to use a computer to retrieve the e-mail 



WO 97/49251 PCT/US97/10441 

message. In the voice mail example, it may the case that, on the particular day the voice mail 
message was left, the intended receiver has access to a computer terminal and modem, but 
does not have access to a telephone to retrieve the voice mail message. In the e-mail 
example, on the day that the e-mail was sent, the intended receiver may have access to a 
5 telephone, but may not have access to a computer terminal and modem to read the e-mail 
message. In both instances, the message receiver may be unable to retrieve the message 
because the available communication mode may not be used to retrieve the message. 
Furthermore, even if the message receiver has access to a telephone, a computer, or some 
other communication device, the receiver may prefer using one device over the others. For 

10 example, the receiver may spend most of his working day on a computer and may therefore, 
prefer to retrieve all of his inbound messages — regardless of the originating communication 
medium — using his computer. 

The inability to alter the message medium after a message has been sent (or to use a 
communication mode other than the one selected by the sender) unnecessarily burdens both 

15 message senders and message receivers. Senders and receivers may be required to select a 
medium prior to communicating so the parties are assured the communication will be 
received in a timely manner. If circumstances for the receiver change at any point following 
selection of the medium and the receiver is unable to notify the sender of the change, the 
receiver may risk missing the sender's communication because the message may not be 

20 accessible using an alternate communication mode. In addition, the inability of a message 
receiver to retrieve all inbound messages using a single communication mode or device 
results in additional burdens. Receivers are inconvenienced when they are required to switch, 
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for example, between the telephone to retrieve voice mail messages and the computer to 
retrieve e-mail messages. 

Technologies have been introduced that address the inconveniences imposed by 
widespread use of different messaging media. For example, Text-To- Speech (TTS) 
5 technology allows written messages to be heard by a message receiver. However, message 
receivers are generally required to integrate this technology into their own customized 
telecommunications/computer environments. Messages in differing media (e.g., e-mail, voice 
mail, fax mail) have not been seamlessly integrated into a single, universal mailbox with 
capabilities for same-media and cross-media notification and responses. 

10 SUMMARY OF THE INVENTION 

The present invention addresses the limitations in current communications technology 
that require receivers to retrieve messages in accordance with a predetermined 
communication medium or in accordance with the communication mode selected by senders. 
The present invention is a seamlessly integrated communications system that combines e- 

15 mail, voice mail, and fax mail messages in a universal mailbox with capabilities for same- 
media and cross-media notification and responses. The universal mailbox supports cross- 
media messaging so all inbound messages — regardless of the originating communication 
medium — may be retrieved by a message receiver using a single access device or 
communication mode such as a telephone or computer. Cross-media notification capabilities 

20 allow a message receiver, for example, to be paged when a new e-mail message arrives or to 
get an e-mail message when a voice mail message arrives. Cross-media responding allows a 
message receiver, for example, to send a voice mail message in response to an e-mail 
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message, send an e-mail message in response to a voice mail message, send a fax in response 
to an e-mail message, etc. 

The universal mailbox serves as a single access point for communication media such 
as e-mail, voice mail, and fax mail and allows message receivers to access their messages 
5 using a single communication mode or device. In a first communication mode using a 
standard telephone, receivers may listen to voice mail messages, redirect fax mail to a fax 
machine, or "listen" to e-mail messages. E-mail messages are automatically reformatted or 
converted to a voice mail format through a text-to-speech conversion process. In a second 
communication mode using a computer and modem, users may playback voice mail 
10 messages, view fax mail messages, or read e-mail messages. Messages are automatically 
reformatted or converted into the appropriate format (e.g., xing protocol.) 

The present invention also provides an alternative platform from which to deliver 
newsworthy and up-to-date information. Using a standard telephone (telephone access), users 
may listen to the latest stock quote prices, news stories about competitors and customers, and 
15 sports score updates from favorite sports teams— information generally available only via on- 
line databases. Message reformatting or conversion is done automatically by a 
telecommunications or remote access (on-line) information service provider (collectively, 
access services) that deliver inbound messages so message receivers need only specify a 
preferred communication medium to take advantage of the features and functionality of the 

20 present invention. 

The present invention offers a variety of features to both "senders" and "receivers" of 
messages. Senders are users who address communications to the universal mailbox. Senders 
use a particular communication mode (e.g., telephone, computer/modem) to send messages. 
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Initially, messages are routed to and stored in a mailbox (i.e., message repository) compatible 
with the sender's communication mode/medium. For example, messages sent via the 
telephone may be stored in a voice mailbox. Messages sent via a computer and modem may 
be stored in an electronic mailbox. 
5 Receivers are owners of the universal mailbox and are the users to which the 

individual voice mail, fax mail, and e-mail messages are addressed. For a receiver, the 
universal mailbox serves as a single message repository from which the receiver may retrieve 
voice mail, fax mail, and e-mail messages. To take advantage of the universal mailbox, the 
message receiver indicates a preferred communication medium by selecting options that 

10 define rules to be applied automatically by the service provider or access service to inbound 
messages. For example, a receiver may, by selecting certain options, define a rule to request 
that messages initiated via the telephone be stored in a voice mailbox and forwarded to an e- 
mail mailbox for later viewing. Alternatively, a receiver may, by selecting certain options, 
define a rule to request that messages initiated via a computer/modem (i.e., e-mail messages) 

15 be stored in an e-mail mailbox and forwarded to a voice mailbox for later retrieval. Any 
reformatting or conversion of the message that is required is performed automatically as part 
of the forwarding operation. Receivers and senders may also select options for defining rules 
to send and receive notifications of incoming messages. Although messages may be stored in 
and/or forwarded to different physical locations, from the message receiver's viewpoint, there 

20 is one universal mailbox (or message repository) that he or she may access to retrieve 
inbound messages. 

To use the universal mailbox of the present invention, the receiver selects filter and 
forward options to define rules applicable to inbound messages. As messages addressed to 
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the receiver arrive at the access service (which facilitates delivery of the message), the 
receiver's rules are applied so all forwarding and conversion of messages (if necessary) may 
be performed automatically. In addition, notification rules, if defined, are applied so the 
receiver may be alerted to the incoming messages. The receiver then uses the appropriate 
5 communication mode (e.g., telephone, computer) to retrieve the inbound messages. For 
example, a receiver may dial into a voice mailbox with a standard telephone and listen to 
voice mail messages, redirect fax mail to a local fax machine, or "listen" to e-mail messages 
(telephone access.) Alternatively, a user may dial into an e-mail mailbox with a computer 
and playback voice mail messages, view fax mail messages, and read e-mail messages 
1 0 (computer access.) 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a system organization diagram of the primary components for a preferred 

embodiment of the present invention; 
Figure 2 is a diagrammatic representation of the functionality of the present invention; 
15 Figure 3 is a data flow diagram for a preferred embodiment of the present inventipn; 

Figure 4 is a block diagram of the primary components for a telephone access 

service's internal network for a preferred embodiment of the present invention; 
Figure 5 is a block diagram illustrating a preferred method for replying via the 
telephone to electronic mail messages for a preferred embodiment of the present 
20 invention; 

Figure 6 is a flow diagram for the voice mail filter and forward options of the present 
invention; 
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Figure 7 is a flow diagram for the fax mail filter and forward options of the present 
invention; 

Figure 8 is a flow diagram for the electronic mail filter and forward options of the 
present invention; 

Figure 9 is a flow diagram for the live operator assistance filter and forward options of 

the present invention; 
Figure 10 is a diagrammatic representation of the voice mail telephone dial-in access 

user options for a preferred embodiment of the present invention; 
Figure 1 1 is a diagrammatic representation of the fax mail telephone dial-in access 

user options for a preferred embodiment of the present invention; 
Figure 12 is a diagrammatic representation of the electronic mail telephone dial-in 

access user options for a preferred embodiment of the present invention; 
Figure 13 is a diagrammatic representation of the voice mail computer dial-in access 

user options for a preferred embodiment of the present invention; 
Figure 14 is a diagrammatic representation of the fax mail computer dial-in access 

user options for a preferred embodiment of the present invention; 
Figure 15 is a diagrammatic representation of the electronic mail telephone dial-in 

access user options for a preferred embodiment of the present invention; 
Figure 16 is a diagrammatic representation of a common message format for a 

preferred embodiment of the present invention; and 
Figure 1 7 is a flowchart for the telephone access service call flow for a preferred 

embodiment of the present invention. 
DETAILED DESCRIPTION OF PREFERRED EMB O D IM ENTS) 
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The present invention is a sophisticated computer system that facilitates 
communications between senders and receivers of e-mail, voice mail, and fax mail messages. 
The system is comprised of a collection of application programs and services hosted on 
different computers (or servers) and various devices that are interconnected by an 
5 infrastructure that supports communications between the participating entities. In a preferred 
embodiment of the present invention, the application programs and services as well as the 
supporting hardware components of the present invention may be developed and maintained 
by different service providers who cooperate with one another to provide the features and 
functionality of the present invention. Using this arrangement, each service provider may 

10 focus on the development of technology suited to its particular area of expertise. In an 
alternative embodiment of the present invention, the features and functionality may be 
developed and maintained by a single service provider or access service. The service 
provider or access service on which the message receiver relies for delivery of voice mail, e- 
mail, and fax mail messages knows the receiver's preferences as defined in a set of rules so 

15 all messages may be delivered to the receiver in accordance with his or her preferences. The 
ability to receive cross-media messages and notifications based on rules defined in 
accordance with user preferences is unique to the present invention. 

The features and functionality of the present invention may be described in 
accordance with the following terms: 



Message: 


a communication in writing, speech, 
or signals; substantive information 
to be conveyed from one party to 
another 


Senders: 


users sending messages to a user of 
the universal mailbox 


Receivers: 


users of the universal mailbox who 
receive messages from senders 
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CompuServe Mailbox: 


on-line mailbox into which 
receivers dial with a computer and a 
modem to retrieve their voice, fax, 
and e-mail messages 


Premiere Mailbox: 


mailbox into which receivers dial a 
standard telephone to retrieve their 
voice, fax and e-mail messages 


Voice mail: 


a recorded voice message sent to the 
universal mailbox 


Fax mail: 


a digitized fax message sent to the 
universal mailbox 


E-mail: 


a text message sent to the universal 
mailbox 


Sender Options: 


options to send voice, fax, text or 
translated voice-to-text messages 


Receiver Options: 


options available to immediately 
notify a receiver of a new message 
or to deliver a message to an 
alternate device/address 


Filter and Forward: 


process of applying rules based on 
the sender of a message to 
immediately notify a receiver of a 
new message or to deliver a 
message to an alternate 
device/address 


Store and/or Forward: 


process of storing messages for later 
review 


Universal Mailbox: 


integrated message repository for 
accessing messages using different 
communication modes; may be 
comprised of message repositories 
maintained by different service 
providers 


Message Data: 


addressing/routing information and 
substantive information to be 
conveyed to a receiver 


Message Format: 


method of organizing/ 
arranging/encoding message data to 
facilitate transport, storage, 
retrieval, display, etc. 


Communication/Message 
Medium: 


method for conveying a message 
such as voice mail, e-mail, fax mail 


Communication Mode: 


means or method for sending or 
receiving messages such as a 
telephone, computer, pager, etc. 
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Service Provider: 



provider of access to a universal 
mailbox in accordance with a 
particular communication mode 
(e.g., telephone access, computer 
access). A single service provider 
may support more than one 
communication mode or several 
service providers may support a 
single communication mode. 



Referring to Figure 1, a system organization diagram for a preferred embodiment of 
the present invention is shown. The universal mailbox of the present invention may actually 
be comprised of more than one message repository 10, 12. Inbound messages in accordance 
5 with a first communication medium that are to be retrieved using a second communication 
medium may be stored initially in one message repository and then copied to another message 
repository for conversion and forwarding to the intended receiver. Reformatting and/or 
conversion may be performed as part of the message forwarding operation. Alternatively, 
reformatting/conversion operations may be performed when a receiver retrieves messages. 

10 Communications with each message repository may be facilitated by message servers that 
process inbound and outbound messages. For example, the message servers may apply a 
message receiver's rules (as defined in accordance with filter and forward options) to the 
receiver's inbound messages. Sender rules may be applied by the message servers to 
outbound messages. Collectively, the servers and associated message repositories function as 

15 message gateways so that users may access messages in different communication media using 
different communication modes. 

Each mailbox shown in Figure I (10, 12) may serve as a repository for a receiver's 
messages and may store messages in accordance with pre-defined protocols and formats for 
accessing, reviewing, and managing the messages. The message repository may be 
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implemented as a database from which messages may be retrieved. Access to and 
communications with a message repository that is part of the universal mailbox may be 
facilitated by a computer access service provider such as the CompuServe Information 
Service 14. Access to and communications with a universal mailbox message repository may 
5 also be facilitated by a telephone access service provider such as Premiere Communications 
16. In the event the message repositories 10, 12 are maintained by different service providers 
14, 16, a dedicated communication link 1 8 may be established between the repositories 10, 12 
so messages may be transferred between the repositories, reformatted or converted if 
necessary, and hence, delivered to message receivers in a timely manner and in accordance 
10 with the receiver's preferences. In a preferred embodiment of the present invention, the 
dedicated communication link is a X.25 link between network nodes belonging to the 

c 

respective service providers. Message repositories may hold both inbound and outbound 
messages. 

Different service providers 14, 16 may facilitate access to message repositories of the 
15 universal mailbox in accordance with different communication modes. For example, one 
service provider 14, such as the CompuServe Information Service, may provide access to a 
message repository via a computer and modem 20 (computer access.) The computer may be 
equipped with connection software that has a graphical user interface, such as the 
CompuServe Information Manager for Windows (WinCIM). The connection software allows 
20 the user to establish and maintain a connection 22 with the on-line information service 14 and 
to perform tasks and interact with the service. Preferably, the connection software is 
equipped with an audio file player so that the user may listen to voice mail messages in an 
audio file format such as the "x/ng" file format. The connection software is also, preferably, 
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equipped with a fax viewer so the user may view fax mail messages. Another service 
provider 16, such as Premiere Communications, may provide access to a message repository 
via a telephone 24 (telephone access.) Users of the service may send and retrieve messages 
by pressing buttons in response to menu options and talking to recording devices or live 
5 operators. With the present invention, message senders and receivers may choose the user 
interface (e.g., graphical user interface, automated telecommunications interface) with which 
they are most familiar and comfortable to both send and retrieve messages regardless of the 
communication medium selected by the original message sender or receiver. 

Each service provider or access service may install and maintain servers 26, 28, 30, 

10 32, network nodes, and other devices (e.g., switches) configured in accordance with known 
methods for establishing wide area or local area networks that support the services offered by 

| the provider. Users choose a communication mode (such as a computer 20 or a telephone 24) 
to establish connections 22, 34 with the service provider's network. Interactions with 
message repositories 10, 12 may then be facilitated by Communications Servers 28, 32 that 

15 are in turn accessible via Network Nodes 26, 30 that manage network traffic between 
message senders and receivers 34, 36 and message repositories 10, 12. 

Communications between a message sender and a message receiver may be 
accomplished in accordance with the present invention as follows. A message sender 20 
(who happens to be an information service subscriber, but does not have to be) who wishes to 

20 send an e-mail message to a message receiver 24 may establish a connection 22, via a 
Network Node 26, with an information service 14 such as the CompuServe Information 
Service. Alternatively, messages may be sent through other third party sources or services 
such as the Internet, etc. to the information service 14. The message sender 34 composes the 

12 
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message on the computer 20, supplies an identifier for the message receiver (such as a 
member number), and sends the message. The e-mail message may be routed by the Network 
Node 26 to a Communications Server 28 of the information service which, based on known 
preferences of the message receiver 36 as defined in a set of rules, makes arrangements to 
5 forward the e-mail message to another service provider 16 (e.g., Premiere Communications) 
that facilitates access to e-mail messages via the telephone 24. The e-mail message may then 
be stored in a message repository 12 of the telephone access service provider 16 for later 
access by the message receiver 36. When the message receiver 36 calls in to retrieve his 
messages, the original e-mail message may be translated by the Communications Server 32 
10 using a text-to-speech translation process. Although the message sender 34 chose to 
communicate with the message receiver 36 via e-mail, using the present invention, the 
message receiver 34 is able to access the message using a different communication mode (i.e., 
the telephone 24.) The conversion of the message from one communication medium to 
another is performed automatically. The present invention allows the message receiver to 
15 select options to define a rule that then allows him or her to "listen" to e-mail messages which 
have been forwarded from the information service message repository 10 to the telephone 
service message repository 12. 

The message receiver 36 may also be a message sender and the message sender 34 
may be a message receiver. To send a voice mail message to a message receiver, the message 
20 sender 36 may access the telecommunications network 34 of the telephone access service 16 
(e.g., Premiere Communications) to leave a voice mail message for a message receiver. The 
voice mail message may be routed by the Network Node 30 to a Communications Server 32 
of the telephone access service 16 which, based on known preferences of the message 
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receiver 34, makes arrangements to forward the voice mail message (e.g., via e-mail 
messaging capabilities such that the voice mail message as stored in an audio file is attached 
to an e-mail message) to another service provider 14 (e.g., CompuServe Information Service.) 
The e-mail message and associated voice mail message in the audio file may then be stored in 
5 a message repository of the computer access service provider 14 for later access by the 
message receiver 34. When the message receiver logs in or connects to the information 
service (using a computer 20) to retrieve her e-mail messages, the message receiver may 
retrieve the original voice mail message by accessing the associated e-mail message. The 
computer's 20 connection software equipped with the audio player may then play for the 

10 message receiver 34 the original voice mail message as stored in the audio file format Fax 
mail messages may also be forwarded in a similar manner from the telephone access service 
16 to the computer access service 14 so message receivers may view fax mail messages using 
the fax viewer capabilities of the connection software. 

Referring to Figure 2, an overview of the functionality provided by the present 

15 invention in a preferred embodiment in which two access service providers cooperate to 
provide services and functionality in accordance with the present invention is shown. As 
shown in Figure X using the telephone to dial into the universal mailbox, a user may listen to 
voice mail, review and forward faxes, determine if e-mail has been received, convert an e- 
mail message to a fax mail message and forward it to a local fax machine, talk to an operator 

20 to set up rules for processing inbound messages (e.g., arrange for notification of inbound 
messages), and make long distance calls. Using the computer to access the universal 
mailbox, a user may check e-mail, voice mail, and fax mail messages, review long distance 
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charges on-line, and select options to set up rules for filtering and forwarding of information 
to the dial-in or telephone access service. 

Referring to Figure 3, the flow of data between two access service providers in 
accordance with a preferred embodiment of the present invention is shown. As shown in 
5 Figure 3, inbound fax mail and voice mail messages are first processed by a telephone access 
service (e.g., Premiere.) Depending on the options selected by the sender and receiver, 
messages and/or notifications may be forwarded to the computer access service (e.g., 
CompuServe.) Inbound e-mail messages are first processed by a computer access service 
(e.g., CompuServe.) Depending on the options selected by the sender and receiver, messages 

10 and/or notifications may be forwarded to the telephone access service (e.g., Premiere.) Also, 
depending on the options selected by the receiver, rules may be applied to messages so they 
are converted automatically from one communication medium to another. 

Referring to Figure 4, a block diagram of the primary components for a telephone 
access service's (e.g., Premiere) internal network for a preferred embodiment of the present 

15 invention is shown. The telephone access service's system, preferably, supports receiving, 
playing, saving, deleting, faxing, and replying to e-mail messages. As shown in Figure 4, the 
functionality may be provided by several nodes. The nodes and servers that comprise the 
telephone access service's internal network may be part of a local area network as supported 
by a commercially available networking package such as Novell's Netware 72. Preferably, 

20 one node (e.g.. CompuServe Node) 60 serves as an e-mail gateway to the computer access 
service's network. This e-mail gateway node 60 handles the downloading of sign-up requests 
and new e-mail messages as well as the sending of e-mail message replies. It receives a 
forwarded copy from the computer access service of each e-mail message for participating 
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subscribers. Also, it maintains the X.25 dedicated link to the computer access service's 
network. Preferably, the e-mail gateway node handles only e-mail and is not responsible for 
call handling. The e-mail gateway node repeatedly checks the mailbox account (e.g., 
Premiere's Mailbox) 58 at the computer access service (e.g., CompuServe) 14 for new e-mail 
5 messages and handles sending e-mail replies to the mailbox account 58. Preferably, another 
server (e.g., E-mail) 62 is dedicated to the storage and retrieval of e-mail messages. When 
the e-mail gateway node receives a new e-mail message, it notifies another network 
management node (e.g., Netman) 64. This network management node 64 may, in turn, 
modify a customer database, for example, when a sign-up request is received. In general, the 

10 e-mail gateway node handles low-level e-mail transmission details while telephone calls are 
processed by other dedicated nodes (e.g., TTSNode and Telnode) 66, 68 and a switch 70. 

In a preferred embodiment of the present invention, one node (e.g., TSSNode) 66 is 
dedicated to providing e-mail functionality during telephone calls. This e-mail functionality 
node 66 plays, saves, deletes, notifies, faxes, and creates e-mail replies. Generally, calls may 

15 be processed by a call processing node (e.g., Telnode) 68. However, when special buttons are 
pressed (e.g., *1), the call may be transferred to the e-mail functionality node 66. When the 
caller finishes with e-mail related features, the call may be transferred back to the call 
processing node 68 when the caller presses a button (e.g., *). 

In accordance with the preferred embodiment of the present invention, inbound e-mail 

20 messages may be processed as follows. Referring to Figure 4, a message sender 50 who 
happens to be a computer access service subscriber 54 (but is not required to be a computer 
access service subscriber) connects 52 to the computer access service 14 to send an e-mail 
message to another on-line service subscriber 56. When the e-mail message reaches the 
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message receiver's mailbox 56 at the computer access service, a rule is activated which 
indicates the e-mail is to be forwarded to the telephone access service's (e.g., Premiere) 
mailbox 58. The e-mail gateway node (e.g., CompuServe Node) 60, which uses the dedicated 
link 18 to continually poll the telephone access service's mailbox 58, downloads the new e- 
5 mail message, saves it on an e-mail server 62, and notifies the network management node 
(e.g., Netman) 64 that a new e-mail message has arrived for the message receiver. 

Referring to Figure 5, the message receiver 76 may respond as follows. The message 
receiver 76 calls the telephone access service (e.g., Premiere) 16 access number. The call is 
processed by a switch 70 and call processing node (e.g., Telnode) 68 as follows. The caller 

10 76 enters an authorization code and a personal identification number. The e-mail gateway 
node is searched to determine whether there are new e-mail messages in the caller's account. 
In this example, the caller has a message and is given the option of retrieving it by pressing a 
button sequence. The caller presses buttons (e.g., *1) to retrieve it. The call is transferred 
from the call processing node 68 to the e-mail functionality node 66 which answers the call. 

15 The caller presses a button (e.g., 1) to hear the new e-mail message. The e-mail functionality 
node 66 performs the necessary conversion and plays the e-mail message which is actually 
located on the e-mail server 62. After listening to the e-mail, the caller may reply by pressing 
a button (e.g., 4) and selecting from a list of short messages. When the caller finishes with 
other e-mail related tasks (e.g., listening, saving, deleting, faxing, and setting options), he 

20 presses a button (e.g., *) to make a call and is transferred from the e-mail functionality node 
66 to the call processing node 68. 

Both message senders and message receivers have a variety of message management 
options available to them. By selecting from among the available options, a set of rules to be 
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applied to a sender or receiver's messages may be defined. Message management options are 
used to control the sending and receiving of messages and associated notifications so they are 
delivered in accordance with the preferences of both senders and receivers. Sender options 
are the choices a user has to send a message to the universal mailbox of a message receiver. 
5 Preferably, a sender may select a mode by which a message may be sent — for example, a 
standard telephone for voice or fax mail or a computer/modem for e-mail. The options 
available to a sender depend in part on the communication mode and related services offered 
by the provider. 

Message receivers also have options that allow them to manage the retrieval of 
10 messages. The options allow message receivers to select the communication medium by 
which they would like to receive/retrieve their messages. By selecting from among the 
available options, a rule for cross-media messaging may be defined so that all of a message 
receiver's incoming messages are forwarded, converted if necessary, and stored in a single 
message repository from which the receiver may retrieve the messages. Cross-media 
15 responding is also possible so message receivers may respond to a message using a different 
communication medium that the communication medium in which the message was 
retrieved. For example, a message receiver may respond to voice mail using e-mail, respond 
to e-mail using voice mail, response to fax mail using e-mail, etc. 

Inbound message options also allow a receiver (1) to be notified immediately of an 
20 inbound message and/or to redirect a message to an alternate device/address (i.e., perform an 
immediate action in response to the arrival of the message — immediate filter and forward 
options) or (2) to have messages stored in the original communication medium format or a 
second communication medium format for later retrieval (store and forward options.) Store 
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and forward options provide the receiver with different ways, upon dialing in with a 
telephone or a computer, to retrieve and manage messages that have been stored. 

Based the receiver's immediate filter and forward option settings, the receiver may be 
notified of an incoming message as messages (or portions of messages) may be immediately 
5 forwarded to alternate target devices/addresses such as a pager or electronic mailbox. For 
example, if an important voice mail message arrives at the intended receiver's voice mailbox, 
a notification may be sent. Notifications may include cross-media notifications in which a 
receiver may be notified using a communication medium that is different than the original 
communication medium used by the sender. For example, a page may be sent to an 

1 0 alphanumeric pager alerting the receiver that an e-mail message has arrived. Alternatively, an 
e-mail message may be sent in response to the arrival of a voice mail message. The filtering 
rules (in accordance with the filtering options selected by the receiver) applied to the message 
are based on the sender's originating telephone number or e-mail address. The forwarding 
options available are determined by the type of message received from the sender (e.g., voice 

15 mail, fax mail or e-mail) and the alternate target device/address (e.g., pager, e-mail account, 

fax machine, voice mailbox). 

Referring to Figure 6, voice mail message immediate filter and forward options are 

shown. When a voice mail message is received, the receiver has several forwarding options 

based on who sent the message (as determined by the originator's telephone number): 

20 • No forwarding — hold the voice mail message in the telephone access 

message repository for later dial-in pickup. 

• Convert the voice mail message file to an audio format (such as xing) and 
download to the receiver's computer access message repository mailbox so 
the user may "listen" to the voice mail message using connection software 
25 with appropriate audio format (such as xing) support. 
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• Send an alert (including the sender's name/number) to any e-mail address 
(CompuServe, Internet, etc.) that a voice mail message is waiting at the 
telephone access message repository. A copy of the voice mail message is 
left at the telephone access message repository. 

5 • Send an alert (including the sender's name/number) to a pager that a voice 

mail message is waiting at the telephone access message repository. A 
copy of the voice mail message is left at the telephone access message 
repository. 

• Send an alert (including the sender's name/number) to any fax machine 
10 that a voice mail message is waiting at the telephone access message 

repository. A copy of the voice mail message is left at the telephone 
access message repository. 

• Dial a cellular or landline telephone and play the voice mail to the receiver. 

In addition, a receiver may choose to use several of these rules for one inbound voice 

1 5 message. For example, a receiver may wish to be notified via a pager and have the voice mail 

message forwarded to his or her computer access message repository. 

Referring to Figure 7, when a fax mail message is received, the receiver has several 

immediate filter and forward options based on who sent the message (as determined by the 

originator's telephone number): 

20 • No forwarding — hold the fax mail message in the telephone access 

message repository for later dial-in pickup. 

• Download the fax file to the receiver's computer access message 
repository. The user may "view" the fax mail message using connection 
software with fax viewer capabilities. A voice message sent with the fax 

25 may also be converted to an audio format protocol (such as xing) and 

downloaded to the computer access message repository (as a multipart 
message). 

• Send an alert (including the sender's name/number) to any e-mail address 
(CompuServe, Internet, etc.) that a fax mail message is waiting at the 

30 telephone access message repository. A copy of the fax mail message is 

left at the telephone access message repository. 

• Send an alert to a pager (including the sender's name/number) that a fax 
mail message is waiting at the telephone access message repository. A 
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copy of the fax mail message is left at the telephone access message 
repository. 

• Redirect any inbound fax to an alternate fax machine. A copy of the fax 
mail message may or may not be left at the telephone access message 
repository. 

• Dial a cellular or landline telephone and play the voice message that 
accompanied the fax mail message. 

In addition, a receiver may choose to use several of these rules for one inbound fax 
message. For example, a receiver may wish to be notified via a pager and have the fax mail 
message forwarded to his or her computer access message repository. 

Referring to Figure 8, when an e-mail message is received, the receiver has several 
immediate filter and forward options based on who sent the message (as determined by the 
originator's e-mail address.) Additional rules include keyword searches on subjects and 
priority/high importance messages: 

• No forwarding — hold the e-mail message in the computer access message 
repository for later on-line dial-in. 

• Download the e-mail message to the receiver's telephone access message 
repository. The user may "listen" to the e-mail message using text-to- 
voice translation by dialing into the telephone access service message 
repository. A copy may or may not be left at the receiver's computer 
access message repository. 

• Redirect the e-mail message to any e-mail address (CompuServe, Internet, 
etc.). A copy of the e-mail mesisage may or may not be left in the 
computer access message repository. 

• Send an alert (including the sender's name/e-mail address and message 
text) to a pager that an e-mail message is waiting at the computer access 
message repository. A copy of the e-mail message is left in the computer 
access message repository. 

• Convert and redirect inbound e-mail message to a fax machine. A copy of 
the e-mail message may or may not be left in the computer access message 
repository. 
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Dial a cellular or landline telephone and play the text-to-voice converted 
message or a portion of that message (e.g., "You have received a message 
from with subject .") 



5 In addition, a receiver may choose to use several of these rules for one inbound e-mail 

message. For example, a receiver may wish to be notified via a pager and have the e-mail 

message forwarded to his or her telephone access message repository. 

Referring to Figure 9, when an operator takes a message and transcribes it into a text 

message, the receiver has several immediate filter and forward options: 

10 • Send the text message (including the sender's name and message text) to 

any e-mail address (CompuServe, Internet, etc.) 

• Send the text message (including the sender's name and message text) to a 
pager. A copy of the e-mail message is left in the computer access 
message repository. 

1 5 • Convert and redirect the text message to a fax machine. 

When a live call is on hold, the receiver has several options to be connected with the 

call: 

• A message may be sent to a pager and the receiver calls back in to join the 
live call. 

20 • A call may be made to a cellular telephone and/or a landline telephone. If 

the receiver answers, he or she is patched into call on hold. 

• If the receiver cannot be located, the sender may be placed into the voice 
mail 

In addition to immediate filtering and forwarding of messages, a receiver may also 
25 store messages for later review and forward them after initial viewing. A receiver's inbound 
messages may be stored in either or both of two message repositories: the computer access 
message repository and the telephone access message repository. The options available for 
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reviewing and forwarding messages differ based on the communication mode used to retrieve 
the messages and the communication medium. 

For the messages stored in the telephone access message repository, receivers may 
review those messages by dialing in with a standard telephone. The options for reviewing the 
5 messages depend on the type of message (voice, fax ,or e-mail.) 

Referring to Figure 10, as a receiver dials into the telephone access message 
repository, he or she has several store and forward options to review the waiting voice mail: 

• Listen to the voice mail message. 

• Delete or save the voice mail message after review. 

1 0 • Forward the voice mail message to any computer access service account. 

The new receiver may listen to the voice mail message using connection 
software that supports an audio protocol such as "jc/wg." 

• Forward the voice mail message to any telephone access service account. 
This option is similar to the forwarding options available on most 

15 corporate voice mail packages. 

• Forward the voice mail message to a landline or cellular telephone. Using 
this option, a comment may be attached to the original voice mail message 
and delivered to another telephone number. 

• Create a live call to the sender of the voice mail message by selecting a 
20 button (e.g., *). This option may automatically dial the original number 

and a response to the voice mail message may be delivered personally or to 
the sender's voice mail system. 

Referring to Figure 11, as a receiver dials into the telephone access message 

repository, he or she has several store and forward options to review the waiting fax mail: 

25 • Listen to the voice message with the fax mail message and send the fax to 

the local fax machine. 

• Delete or save the fax mail message after review. 

• Forward the fax mail message to any computer access service account. 
The fax mail message may be viewed using connection software with a fax 

30 viewer. 
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• Forward the fax mail message to any telephone access service account. 
This option is similar to the forwarding options available on most 
corporate voice mail packages. 

• Attach a voice-to-text comment with the fax mail message and send the 
5 forwarded fax to any fax machine. 

• Respond to the fax immediately by selecting buttons (e.g., *1) to speak to 
a live operator who transcribes a voice-to-text message. The message is 
delivered to the originating fax machine and/or the fax machine that 
delivered the message. 

10 • The user may also select buttons (e.g., *2) to create a live call to the sender 

of the fax mail message. The sender's voice number is dialed 
automatically and a response to the fax mail message may be delivered 
personally or to the sender's voice mail system. 

Referring to Figure 12, as a receiver dials into the telephone access message 
1 5 repository, he or she has several store and forward options to review the waiting e-mail: 

• Listen to the e-mail message using a text-to-voice translation process. 

• Delete or save the e-mail message after review 

• Forward the e-mail message to any e-mail account. If needed, attach a 
comment to the forwarded e-mail message through a voice-to-text 

20 translation process or with a file in an audio format such as xing, 

• Forward the e-mail message to any telephone access service account. If 
needed, attach a comment to the forwarded e-mail message through a 
voice-to-text translation process or with a voice file. This option is similar 
to the forwarding options available on most corporate voice mail packages. 

25 • Attach a voice-to-text comment with the e-mail, convert to a fax format, 

and send the forwarded e-mail message to any fax machine. 

• Respond to the e-mail message immediately by selecting buttons (e.g., * 1 ) 
to compose a return e-mail message with a voice-to-text translation 
message. In addition, a response may be created by sending a voice file 

30 (e.g., as formatted in accordance with the xing protocol) or by selecting a 

prerecorded message. The message is delivered to the originating e-mail 
address. 

• The user may also select buttons (e.g., *2) to create a live call to the sender 
of the e-mail message. The sender's voice number is dialed automatically 

35 and a response to the e-mail message may be delivered personally or to the 

sender's voice mail system. 
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For the messages that are stored in the computer access message repository, receivers 
may review those messages by dialing in with a modem-equipped computer. The options 
available to review the messages depend on the type of message (voice, fax ,or e-mail.) 

Referring to Figure 13, as a receiver dials into the computer access message 
5 repository, he or she has several store and forward options to review the waiting voice mail 
message (based on the user's earlier choice to have voice mail message forwarded from the 
telephone access message repository to the computer access message repository): 

• Listen to the voice mail message using connection software with audio file 
support (such as xing). 

1 0 • Delete or save the voice mail message after review. 

• Forward the voice mail message to any other computer access service 
account with a text comment (if necessary). The voice mail message may 
be heard using connection software that supports an audio protocol such as 
xing. 

15 Other options may be made at the computer access service interface, but performed at 

the telephone access message repository. For example, if a user wants to forward a voice 
mail message to another telephone access service account or to a cellular/landline telephone, 
this instruction may be delivered back to the telephone access service provider which 
transfers the voice mail message to the appropriate device. 

20 Referring to Figure 14, as a receiver dials into the computer access message 

repository, he or she has several store and forward options to review the waiting fax mail 
message (based on the user's earlier choice to have fax mail message forwarded from the 
telephone access message repository to the computer access message repository): 

• View the fax mail message using connection software with fax viewer 
25 support. 

• Delete or save the fax mail message after review 
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• Forward the fax mail message to any computer access service account with 
a text comment (if necessary). The fax mail message may be viewed using 
connection software with a fax viewer. 

• Attach a comment to the fax mail message and send the forwarded fax to 
5 any fax machine. 

• Respond to the fax immediately by selecting reply and composing a return 
fax. The text message may be delivered to the originating fax machine 
and/or the fax machine that delivered the message. 

Other options may be chosen at the computer access interface, but performed at the 

10 telephone access service. For example, if a user wants to forward a fax mail message to 

another telephone access message repository, this instruction may be delivered back to the 

telephone access service which transfers the fax mail message to the appropriate address. 

Referring to Figure 15, as a receiver dials into the computer access message 

repository, he or she has several store and forward options to review the waiting e-mail 

15 messages: 

• Review the e-mail message 

• Delete or save the e-mail message after review 

• Forward the e-mail message to any e-mail account. If needed, attach a 
comment to the forwarded e-mail message. 

20 • Attach a comment with the e-mail, convert the text to a fax format, and 

send the forwarded e-mail message to any fax machine. 

• Respond to the e-mail immediately by selecting reply and composing a 
return e-mail message. The message may be delivered to the originating e- 
mail address. 

25 Other options may be chosen at the computer access service interface, but performed 

at the telephone access service. For example, if a user wants to forward an e-mail message to 
another telephone access message repository, this instruction may be delivered back to the 
telephone access service which then transfers the e-mail message to the appropriate address. 
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In a preferred embodiment of the present invention, immediate filter and forward as 
well as store and forward options are selected using an on-line interface for the computer 
access service. The options are used to establish rules to be applied to inbound and outbound 
messages. Different rules may be established (via options) for each sender from which a 
5 message receiver expects to receive messages. Preferably, a sender is chosen from an on-line 
address book. By selecting a sender, the e-mail, fax mail, and voice addresses/numbers are 
retrieved automatically from an address database into a filtering rules area so that filtering 
criteria may be established for the sender. Next, the forwarding rules are defined for each 
inbound communication. For example, if a voice mail message is received from John Smith 

10 (the sender), the receiver defines specific voice forwarding options for John Smith. If a fax 
mail message is received from John Smith, the receiver defines specific fax forwarding 
options for John Smith. If an e-mail message is received from John Smith, the receiver may 
specify e-mail forwarding options for the message. The receiver may also set options to 
define rules for receiving notification of incoming messages. 

15 The final step is to download the rules to the telephone access service so voice and fax 

filtering and forwarding preferences may be applied as communications are received at the 
telephone access message repository. Preferably, the telephone access rules database is 
updated as changes are made to the rules in the computer access service rules database so that 
the same filter/forward rules are applied to a message receiver's inbound messages whether 

20 they are initiated by a message sender via the telephone or the computer. 

Referring to Figure 16, a message format for messages exchanged between the 
computer access message repository and the telephone access repository is shown. The 
message may have an envelope 50 and a body 54. The envelope 50 may have a message 
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header that includes several lines of text 60 identifying the service provider to which the 
message may be forwarded and other information regarding the source of the message. The 
body of the message 54 includes the message header 56 and message text 58 of the original 
message. The message header 56 of the body 54 identifies the original message receiver and 
5 the message sender. 

The common message format facilitates the exchange of messages in accordance with 
various communications media so that messages may be retrieved from the universal 
mailbox. The common format is based on known e-mail formats so that messages may be 
forwarded from the computer access message repository to the telephone access message 

1 0 repository using standard e-mail protocols. Using this approach, the telephone access service 
appears to the computer access service to be another member of the service to whom 
messages may be forwarded. The telephone access service may accept all types of messages, 
including multipart and binary messages, that the computer access service is capable of 
processing. Consequently, e-mail messages may arrive at the telephone access service for 

15 reformatting/conversion and distribution to voice mail mailboxes for later retrieval by 
subscribers. 

Using the common message format approach, the telephone access service appears to 
the computer access service to be a service from which e-mail messages also may be 
received. Voice mail messages that originate at the telephone access service may be 
20 forwarded to the computer access service in accordance with an e-mail message that has an 
attached audio file containing the original voice mail message. Computer users may then use 
their connection software to retrieve e-mail messages including those e-mail messages 
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associated with audio files. The connection software, which is equipped with an audio file 
player, may then, at the user's request, play the voice mail message for the computer user. 

Referring again to Figure 1 6, the From line 60 of the inbound message indicates to the 
receiving service provider (e.g., Premiere) the originating service provider (e.g., 
5 CompuServe) so that it may be processed in accordance with the present invention. For 
example, the receiving service provider may apply filter/forward rules according to the 
intended message receiver's preferences and perform any message translation that may be 
required (e.g., translate an e-mail message to a voice mail message format so that the message 
receiver may use the telephone to "listen" to the e-mail message.) Using this scheme, 

ID additional service providers and additional message repositories supporting different 
communication modes may be added easily to the network of message repositories that 
comprise the universal mailbox. 

The common message format also facilitates the distribution of cross-media 
notifications. Notification or paging messages may be nearly identical to the original 

15 message except for the recipients. For the notification/paging message, the telephone access 
service (e.g., Premiere) address may be added as a copy recipient (i.e., a recipient of a copy of 
a message). The original message's recipient may be changed to indicate that the recipient is 
"non-responsible" so a second copy of the message is not delivered to the recipient as a result 
of sending the notification message. By leaving the original recipient on the notification 

20 message, the telephone access service knows who to notify or page. All other attributes of 
the message may remain the same. 

In addition to personal and business communications, the present invention may be 
applied to many other types of communications such as news and other information 
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accessible, for example, from on-line databases. Using the present invention, a message 
receiver may define filter and forward rules to be applied to headline, financial, sports, and 
other news retrieved from on-line databases. The news information may be formatted 
initially in an e-mail message that is then routed to a telephone access service provider for 
5 subsequent retrieval via the telephone. 

Referring to Figure 17, the telephone call flow for a preferred embodiment of the 
present invention is shown. Preferably, the caller is presented with a menu of options for 
retrieval of messages and administration of the universal mailbox. Menus may be nested so 
the selection of a particular option results in the presentation of additional options. 

10 The present invention integrates communications by combining e-mail, voice mail, 

and fax mail in a universal mailbox. In a preferred embodiment, the universal mailbox allows 
users to access their messages in two ways. Using the present invention, messages senders 
may use a first medium for sending messages while message receivers may use a second 
communication medium for receiving messages. Messages may thus be received in a more 

15 timely and convenient manner because message receivers are no longer dependent upon 
accessing their messages using the communication mode of the sender. Forwarding and 
reformatting/conversion are performed automatically so message receivers may take 
advantage of the features of the present invention by selecting options to define rules to be 
applied to inbound messages. Senders may also select options to define rules to be applied to 

20 outbound messages. 

Although the invention is described in detail with specific reference to a single 
preferred embodiment and certain alternatives, it is not limited to that particular embodiment 
or alternatives. For example, the configuration of the components that provide the features 
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and functionality of the present invention may change and fall within the scope and spirit of 
the present invention. The scope of the present invention is defined by the following claims. 
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WHAT IS CLAIMED IS: 

1 . An electronic communications system comprising: 

means for sending messages in accordance with a first communication 
medium; 

5 means for defining rules to apply to said messages; 

means for applying a defined rule to convert said messages in accordance with 
said first communication medium to messages in accordance with a second 
communication medium; and 

means for retrieving said messages in accordance with a second 
10 communication medium. 

2. The system of claim 1 wherein said first communication medium is selected from the 
group of voice mail, electronic mail, and fax mail. 

3. The system of claim 1 wherein said second communication medium is selected from 
the group of voice mail, electronic mail, and fax mail. 

15 4. The system of claim 1 wherein said defined rules arc determined in accordance with 
filter and forward options applicable to said messages in accordance with said first 
communication medium. 

5. The system of claim 4 further comprising immediate filter and forward options. 

6. The system of claim 5 further comprising store and forward options. 

20 7. The system of claim 1 wherein said defined rules comprise sender and receiver 
options. 

8. The system of claim 1 wherein said rules are stored at and applied by an access 
service. 
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9. A method for communicating electronically comprising the steps of: 

(a) defining rules to apply to messages in different communication media; 

(b) composing and sending a message in accordance with a first communication 
medium; 

(c) applying a rule to convert said message in accordance with a first communication 
medium to a message in accordance with a second communication medium; and 

(d) retrieving said message in accordance with said second communication medium. 

10. The method of claim 8 wherein said first communication medium is selected from the 
group of electronic mail, voice mail, and fax mail. 

11. The method of claim 9 wherein said second communication medium is selected from 
the group of electronic mail, voice mail, and fax mail. 

12. The method of claim 9 wherein said defined rules comprise filter and forward options 
applicable to said messages in accordance with said first communication medium. 

13. The method of claim 12 wherein said filter and forward options comprise immediate 
filter and forward options. 

14. The method of claim 12 wherein said filter and forward options comprise store and 
forward options. 

1 5. The method of claim 9 wherein said defined rules comprise sender and receiver 
options. 

1 6. The method of claim 9 wherein said rules are stored at and applied by an access 
service. 
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17. A cross-media communication system comprising: 

a computer network for providing telecommunications services, said 
telecommunications services comprising voice and fax messaging capabilities; 

a telephone access interface for sending and receiving voice and fax messages 
5 via said computer network for providing said telecommunications services; 

an electronic mail gateway for receiving electronic mail messages from an 
information service; and 

means for accessing said electronic mail messages using said telephone access 
interface. 

10 18. The system of claim 1 7 further comprising a means for applying message sender and 
receiver rules to said voice, fax, and electronic mail messages. 
19. The system of claim 1 8 further comprising a means for receiving from said 
information service said rules to apply to said voice, fax, and electronic mail 
messages. 

15 20. The system of claim 1 8 wherein said messages are delivered in accordance with said 
rules. 

21 . The system of claim 1 8 further comprising rules for cross-media notification and 
cross-media responses. 

22. The system of claim 17 wherein said means for receiving electronic mail messages 
20 comprises a dedicated connection to said information service and a means for polling 

via said dedicated connection a mailbox at said information service. 
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23. The system of claim 20 wherein said electronic mail messages are forwarded by said 
information service to said mailbox in accordance with rules applied by said 
information service to inbound electronic mail messages. 

24. A telecommunications network for rendering electronic mail communications 
accessible to a plurality of subscribers equipped with audio input/output apparatus, the 
network comprising: 

(a) an electronic mail subsystem adapted to receive electronic mail messages from a 
third party source; 

(b) electronic mail memory capacity for storing said electronic mail messages; 

(c) a text-to-speech subsystem adapted to (1) receive electronic mail messages from 
the electronic mail memory capacity, (2) convert the electronic mail messages into 
a format for performance via the audio input/output apparatus, and (3) play the 
electronic mail messages for reception by the subscribers; and 

(d) a telecommunications switch connected to the text-to-speech subsystem for 
coupling the text-to-speech subsystem to the public switched telecommunications 
network, and therefore the subscribers to the text-to-speech subsystem. 

25. A telecommunications network according to claim 24 further comprising a call 
processing subsystem and a voice mail subsystem, the voice mail subsystem adapted 
to receive voice mail messages from third party sources, the call processing subsystem 
coupled to the switch and adapted to perform the voice mail messages to subscribers 
of the network. 
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26. A telecommunications network according to claim 25 further comprising a fax 
subsystem, the fax subsystem adapted to receive fax messages from third party 
sources and to send the fax messages to subscribers of the network upon their request. 

27. A telecommunications network according to claim 24, further comprising interface 
circuits adapted to connect the network to a paging network, the telecommunications 
network adapted to inform subscribers when electronic mail messages addressed to 
them have been received by the telecommunications network. 

28. A telecommunications network according to claim 27, in which the 
telecommunications network is further adapted to inform subscribers when electronic 
mail, voice mail, and fax messages addressed to them have been received by the 
telecommunications network. 

29. A telecommunications network according to claim 24 in which the audio input/output 
apparatus comprises telephony equipment that includes a telephone keypad. 

30. A telecommunications network according to claim 29 in which the network is further 
adapted to receive and process responses to electronic mail messages entered by 
subscribers using their keypads. 

31. A telecommunications network for rendering electronic mail, voice mail, and fax mail 
communications accessible to a plurality of subscribers equipped with audio 
input/output apparatus that includes keypad functionality, the network comprising: 

(a) an electronic mail subsystem adapted to receive electronic mail messages from a 
third party source; 

(b) electronic mail memory capacity for storing the electronic mail messages; 
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(c) a text-to-speech subsystem adapted to receive electronic mail messages from the 
electronic mail memory capacity and play the electronic mail messages for audio 
reception by the subscribers; 

(d) a telecommunications switch connected to the text-to-speech subsystem for 
coupling the text-to-speech subsystem to the public switched telecommunications 
network, and therefore the subscribers to the text-to-speech subsystem; 

(e) a voice mail subsystem, the voice mail subsystem adapted to receive and store 
voice mail messages from third party sources; 

(f) a fax -subsystem, the fax subsystem adapted to receive and store fax messages 
received from third party sources, the network adapted to send the fax messages to 
subscribers upon request by the subscribers; and 

(g) a call processing subsystem coupled to the switch and adapted to perform the 
voice mail messages to subscribers. 

32. A cross-media communication system comprising: 

a computer network for providing information services to a plurality of 
subscribers; 

a graphical user interface for use by said subscribers to access and interact 
with said computer network providing said information services; 

an electronic mail gateway for receiving from a telecommunications service 
voice mail and fax mail messages addressed to said subscribers; 

an audio player for playing said voice mail messages, said audio player 
accessible from said graphical user interface; and 
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a fax viewer for viewing said fax messages, said fax viewer accessible from 
said graphical user interface. 
33. The system of claim 32 further comprising a means for defining and storing rules to 
apply to said electronic, voice, and fax mail messages. 
5 34. The system of claim 33 wherein said rules comprise cross-media notification rules. 

35. The system of claim 33 wherein said electronic, voice, and fax mail messages are 
delivered in accordance with said rules. 

36. The system of claim 32 wherein said telecommunications service forwards inbound 
voice mail and fax mail messages to an information service mailbox. 

1 0 37. The system of claim 32 further comprising a means for notifying said subscribers 
when voice mail and fax mail messages addressed to them have been received from 
said telecommunications service. 

38. An information service network for rendering voice mail messages accessible to a 
plurality of subscribers, said network comprising: 

15 an electronic mail gateway for receiving electronic mail messages from a 

telecommunications network, said electronic mail messages comprising audio files 
with voice mail messages originating from said telecommunications network; and 

connection software for use by said subscribers to establish a connection to 
said information service network, to retrieve said electronic mail messages, and to 

20 play said audio files. 

39. A information service network according to claim 38 in which the information service 
network is further adapted to inform subscribers when voice mail messages addressed 
to them have been received by the information service network. 
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40. An information service network for rendering fax mail messages accessible to a 
---- plurality of subscribers, said network comprising: 

an electronic mail gateway for receiving electronic mail messages from a 
telecommunications network, said electronic mail messages comprising files with fax 
mail messages originating from said telecommunications network; and 

connection software for use by said subscribers to establish a connection to 
said information service, to retrieve said electronic mail messages, and to view said 
fax mail message files, 

41. An information service network according to claim 40 in which the information 
service network is further adapted to inform subscribers when fax mail messages 
addressed to them have been received by the information service network. 



WO 97/49251 



PCT/US97/10441 



1/17 




SUBSTITUTE SHEET (RULE 26) 

JNSDOCID: <WO__9749251A1J_> 



WO 97/49251 



PCT/US97/10441 



2/17 



The Universal Mailbox 



Outbound 




SUBSTITUTE SHE! (RULE 26) 



WO 97/49251 



PCTVUS97/10441 



3/17 



The Universal Mailbox 



Inbound 




Fax Store & Forward 



Notification 
Online 
Services 

Fax/Voice 
Notification 



Information 



Outbound 




Email -to-Fax Conversion 



SUBSTITUTE SHEET (ME 26) 

WSDOCID:<WO 974©251A1J_> 



WO 97/49251 



PCT/US97/10441 



4/17 




SUBSTITUTE SHEET PLE 28) 



WO 97/49251 PCT/US97/10441 



6/17 



Sender/ 
Filter & 
Forward 
Options 



Inbound . 
Voice 





Filtering 


- Voice File 


Based 


-Originating 


on 


Number 


Originating 




Number 




H 






O 






L 






D 





Alert to any 
email address 
(# from voice) 



Alert to any 
fax machine 
(# from voice) 



Alert to any 
registered pager 
(# from voice) 



Convert email 
toxingtoQM 
PlayonCDM 



Dial out to a 
cellular or 
landline phone 



Email 



Alerts 



Fax 



Alerts 



Pager 



Alerts 



CIS Voice 



Mail 



Instant Voice. 



Connection 



Filter and Forward 



SUBSTITUTE SHEET (RULE 28) 



WO 97/49251 



PCT/US97/10441 



7/17 



Sender/ 
Filter & 
Forward 
Options 



Inbound . 
Fax 



- Fax file 

- Originating 
number 

- Voice 
message 


Filtering 
Based 
on 

Originating 
Number 


Alert to any 
email address 
(# trom fax) 


Automatic 
redirect to a 
fax machine 


Alert to any 
registered pager 
(# from fax) 


Convert fax/ 
voice to be 
viewed on CIM 




H 
O 
L 
D 




Dial out to a 
cellular or 
landline phone 



Email 
Alerts 



Fax 
Delivery 



Pager 



Alerts 



CIS Fax 



Mail 



nstant Phone | 
Connection 



Filter and Forward 



SUBSTITUTE SBET (ME 26) 



WO 97/49251 PCT/US97/10441 



8/17 



Sender/ 
Filter & 
Forward 
Options 



Inbound, 
Email 





Filtering 
Based 




on 


- Originating 
email 
address 

- Email text 


Originating 
Email 


Address or 
Subject 
Keyword 






H 






O 






L 






D 





Email re- 
directed to any 
email address 



Convert to fax 
and redirect 
to any fax 



Message to any 
registered pager 



Email to 
Premiere dial 
in box 



Notification to 

cellular or 
landline phone 



Email 



Delivery 
Fax 



Delivery 



Pager 



Delivery 



Premiere 



Alerts 



Instant Phone. 



Connection 



Filter and Forward 



SUBSTITUTE SHEET (RULE 2© 



WO 97/49251 



PCTYUS97/10441 



9/17 



Sender/ 
Filter & 
Forward 
Options 



Inbound. 
Voice 



- Originating 


■ 


number or 




vector (voice 


Filtering 


or text) 


Based 


- Operator 


on 


Assisted 


Originating 


Voice-to- 


Number 


Text 




Messaging 





Email to any 
email address 



Text fax to 

any 
fax machine 



Message to any 
registered pager 



Email to CIS 
email address 



Connect to 
cellular or 
landline phone 



Immediate Messaging 



Email 



Delivery 



Fax 



Delivery 
Pager 



Alerts 



Email 



Delivery 



Instant Voice. 



Connection 



3NSDOCID: <WO 9749251A1_L> 



SUBSTITUTE SHEET (WILE 28) 



PCT/US97/10441 



10/17 



ON 
HOLD 


Phone Dial-In Access 
User Options 


- Voice File 

- Originating 

Number 


Listen to the voice mail 


Delete/save the voice mail 


Forward the voice mail to CIM or 
any CIS account; attach voice comment 


Forward the voice mail to another 
Premiere mailbox; attach voice comment 


Forward the voicemail to any phone; 
attach a voice comment; DSP w/ ANS 


Quick reply to the voice mail through 
a *1 option (quick connection) 



SHBSTITHTE 8HEET (RUl£ 28} 



WO 97/49251 



PCT/US97/10441 



11/17 



Inbound 
Fax 



ON 
HOI D 


Phone Dial-In Access 
User Ontion^ 


- Fax file 

- Originating 
number 

- Voice 


Listen to the voice message and 
send the fax to a local machine 


Delete/save the fax mail 


Forward the fax mail to CDvI or 
any CIS account; attach voice comment 


message 


Forward the fax mail to another 
Premiere mailbox; attach voice comment 




Forward the fax to any fax machine; 
attach a voice-to-text comment 




Reply to the original fax through a 
voice-to-text translation process 



SUBSTITUTE SHffT (RULE 26) 

3NSDOCID: <WO 9749251A1_I_> 



PCTYUS97/10441 



12/17 



ON 
HOLD 


x IIOIIC Lyldl"lll -rvL/L/Coo 

User Options 


- Originating 
email 
address 

- Email text 


Listen to the email message 


Delete/save the email 


Reply to the email through voice-to-text 
translation, voice (xing), or canned msgs 




Forward the email to any fax machine; 
add a voice-to-text comment in needed. 


Forward the email to another 
Premiere mailbox; attach comment 


Forward the email to any other email 
address; attach a voice-to-text comment 



SUBSTITUTE SHEET (RULE 26) 



WO 97/49251 



PCT/US97/10441 



13/17 



Inbound. 
Voice 



ON 
HOLD 


L/Onipuier Jjiai-Jii Access 
User Options 


- Voice File 

- Originating 
Number 


Listen to the voice mail using CIM 
with XING (notification without XING) 


Delete/^ave the* vninp mail 

J^WIVIU JQW LA.1W V UlvW 11 lull 


Forward the voice mail to any other 
CIS account; attach text comment 


Forward the voice mail to another 
Premiere mailbox; attach text comment 


Forward the voicemail to any phone; 
attach a text comment; DSP w/ ANS 


Quick reply to the voice mail through 
a *1 option (quick connection) 



9749251 A 1 I > 



SUBSTITUTE SHEET (RULE 28) 



WO 97/49251 PCT/US97/10441 

14/17 



Inbound 



ON 
HOLD 


Computer Dial-In Access 
User Options 


-Fax file 

- Originating 
number 

- Voice 
message 


View the fax message using CEM with 
fax viewer support (alert w/o fax viewer) 


Delete/save the fax mail 


Forward the fax mail to any other CIS 
account; attach text comment 


Forward the fax mail to another 
Premiere mailbox; attach text comment 


Forward the fax to any fax machine; 
attach a text comment 


Reply to the original fax by selecting 
"reply" and sending a text message 



SUBSTITUTE SHEET (R0i£ 2(Q 



WO 97/49251 



15/17 



Inbound . 
Email 



ON 
HOLD 


1 TXt T~X •IT A 

Phone Dial-In Access 
User Ootions 


- Dfioinfltino 

email 
address 

- Email text 


Review the email message 


Delete/save the email 


Reply to the email 




Forward the email to any fax machine; 
add a text comment in needed. 


Forward the email to another 
Premiere mailbox; attach comment 


Forward the email to any other email 
address; attach text comment 



SUBSTITUTE SHffTPLE 28) 



3NSDOCID: <WO 974&2S1A1 I > 



WO 97/49251 



PCT/US97/10441 



16/17 




CD 
cd 

GO 
CO 
CD 



•c -.2 
o cu 

o _ 

<D cS 

.•^ o 

C/3 H 



15 
Q 



cd 

■g 
5b 



e 

CD 

- O 

CO • • 

o « 

to Q 



a> 



a 

a 



u 

W 

CD 

W> 

OS 

s 



H 

en 
« 

CA 
CO 



o 

Oh 

o 
Id 



o 
PQ 



SUBSTITUTE SHEET (RULE 26) 



WO 97/49251 



PCT/US97/10441 



17/17 
CALL FLOW 
E-MAIL MENU* I 



( IF MESSAGE IN MAILBOX...) YOU HAVE X NEW (AND Y SAVED) E-MAIL 
MESSAGES. TO LISTEN TO YOUR MESSAGES, PRESS I. TO CHANGE 
YOUR MAILBOX OPTIONS, PRESS 3. 

(ELSE IF NO MESSAGES IN MAILBOX...) YOU HAVE NO NEW E-MAIL 
MESSAGES. TO CHANGE YOUR MAILBOX OPTIONS, PRESS 3 



[FIRST/NEXT][NEW/SAVED] MESSAGE. 
(PLAY THE MESSAGE.) 
TO PLAY THIS MESSAGE AGAIN, PRESS I. TO SAVE IT, PRESS 
2. TO DELETE IT, PRESS 3. TO REPLY TO IT, PRESS 4. 
TO FAX IT; PRESS 5. TO PLACE A CALL, PRESS # 



I- 



(PLAY THE MESSAGE) 



-2- 



(SAVE THE MESSAGE) 
MESSAGE SAVED. 



-3 



(DELETE THE MESSAGE) 
MESSAGE ERASED. 



(REPLY MENU) 



PLEASE DIALTHE AREACODE AND NUMBER 
OF THE FAX MACHINE NOW. (GET FAX 
NUMBER) YOUR E-MAIL WILL BE FAXED 
TO YOU IMMEDIATELY. 



TO TURN YOUR E- MAILBOX |ON/OFF] PRESS I . 
TO TURN E- MAIL NOTI FICATION [ON /OFF] PRESS 2. 



(TURN E- MAILBOX [ON/OFF]) 



2 ► (TURN E-MAIL NOTIFICATION [ON/OFF]) 

SUBSTITUTE SHEET (RULE 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US97/10441 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :H04N 11/00 

US CL : 379/93.24, 100.08 
According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 379/93.01, 93.14, 93.15, 93.17, 93.18, 93.24, 100.08, 100.09, 100.13, 88, 89 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 4 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



X 
Y 

X 
X 



US 5,349,636 A (IRRIBARREN) 20 September 1994, Figs. 3, 
4, 6 and 8. 



US 4,837,798 A (COHEN ET AL.) 06 June 1989, Figs. 6-9. 

US 5,333,266 A (BOAZ ET AL.) 26 July 1994, Figs. 1-5, 8, 
15 and col. 3, lines 30-64. 

US 5,193,110 A (JONES ET AL.) 09 March 1993, Fig. 1 and 
col. 20, lines 42-49. 

US 5,487,100 A (KANE) 23 January 1996, abstract. 



1-3, 7-11, 15- 

26, 29 30 

27, 28 
1-6, 9-14 
32-41 

31 

27, 28 



~| Further documents are listed in the continuation of Box C. | | See patent family annex. 



•A" 
•B" 

P* 



il in !■ m ill ill fin in| See |tnml itate of the art which u not considered 
to be of peroenkr relrv— nc 

carter docnrwni pwhfrhrH on or after tbe nternebooal films X * 

ilnrfS which may ttow doubai on priority ckfam>) or which it 
cind to anhlwa *e publication date of another citation or other 
speciei ttmm (m apecified) ■ 

document ref erring to an oral dawtoeare, una, exhibition or other 



date end not in conflict with die application hut cited to v 
principle or Djeory uadcrtyRf die invention 

of particular relevance; me churned 
novel or cannot be 



document of perticular relevance; die c! 
no — id i n i t to fevotve an nvenove atop when the 



being obvious to a person akilled m the art 
rofdtti 



Date of the actual completion of the international search 
15 SEPTEMBER 1997 


Date of mailing of the international search report 

0 7 NOV 1997 


Name and mailing address of the ISA/US 
Commiaatoner of Patents end Trademarks 
Box PCT 

Weabiriftioop D.C. 20231 
Facsimile No. (70$) 305-3230 


Authorized officer ^ 

U Stephen P&lan "^J ^^jJ 
Telephone No. (703) 305-3965 



Form PCT/IS A/210 (second sheetXJuly 1992)* 




THIS PAGE BLANK (uspto) 



i 



